Terminal device for providing haptic effect using haptic engine and controlling method therefor

ABSTRACT

A terminal device controlling method that provides a haptic effect using a haptic engine is provided, which includes sensing a haptic event, executing a non-physical parameter-based haptic function in a haptic engine so as to determine a vibration pattern corresponding to the haptic event, transferring the vibration pattern from the haptic engine to a device driver, and driving, through the device driver, a vibrator based on the vibration pattern so as to embody a haptic effect.

PRIORITY

This application claims priority under 35 U.S.C. §119(a) to KoreanApplication Serial No. 10-2013-0030459, which was filed in the KoreanIntellectual Property Office on Mar. 21, 2013, the entire content ofwhich is incorporated herein by reference.

BACKGROUND

1. Field of the Invention

The present invention relates to a terminal device and a controllingmethod therefor, and more particularly, to a terminal device thatprovides a haptic effect using a haptic engine and a controlling methodtherefor.

2. Description of the Related Art

Recently, haptic technology has been applied to terminal devices andhaptic related services have been provided. The haptic technologyvibrates a vibrator or motor included in the terminal device so that auser feels the vibration when a predetermined input is provided to theterminal device. That is, the haptic technology vibrates the terminaldevice in response to a predetermined input, so as to stimulate theuser.

The haptic technology provides a haptic event such as a vibration usinga simple intensity and a duration. Therefore, there is a drawback inthat an application producer is provided with a vibration using a simpleintensity and a duration in response to a predetermined input.

Accordingly, there is a desire for a haptic technology to which variousintensities and durations are applied, and a technology for anapplication producer to readily embody, through easy inputting, thehaptic technology to which various intensities and durations areapplied.

SUMMARY

The present invention has been made to address at least the aboveproblems and disadvantages, and to provide at least the advantagesdescribed below. Accordingly, an aspect of the present invention is toprovide a technology that executes a non-physical parameter-based hapticfunction in a haptic engine so as to determine a vibration patterncorresponding to a haptic event, and drives a vibrator through a devicedriver based on the vibration pattern determined in the haptic engine,so as to embody a haptic effect.

In accordance with an aspect of the present invention, a method ofcontrolling a terminal device that provides a haptic effect using ahaptic engine is provided. The method includes sensing a haptic event;executing a non-physical parameter-based haptic function in a hapticengine so as to determine a vibration pattern corresponding to thehaptic event; transferring the vibration pattern from the haptic engineto a device driver; and driving, by the device driver, a vibrator basedon the vibration pattern so as to embody a haptic effect.

In accordance with an aspect of the present invention, a terminal devicethat provides a haptic effect using a haptic engine is provided. Theterminal device includes a controller configured to sense a hapticevent; execute a non-physical parameter-based haptic function in ahaptic engine so as to determine a vibration pattern corresponding tothe haptic event; transfer the vibration pattern from the haptic engineto a device driver; and drive a vibrator through the device driver basedon the vibration pattern so as to embody a haptic effect; the vibratorthat vibrates the terminal device; and a storage unit that stores thevibration pattern corresponding to the haptic event.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of the presentinvention will be more apparent from the following detailed descriptiontaken in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram schematically illustrating a terminal deviceaccording to an embodiment of the present invention;

FIG. 2 is a front perspective view of a terminal device according to anembodiment of the present invention;

FIG. 3 is a rear perspective view of a terminal device according to anembodiment of the present invention;

FIG. 4 is a flowchart illustrating a terminal device controlling methodthat provides a haptic effect using a haptic engine according to anembodiment of the present invention;

FIGS. 5A and 5B illustrate screens in which a haptic event occursaccording to an embodiment of the present invention;

FIG. 6 is a diagram illustrating a haptic pattern according to anembodiment of the present invention;

FIG. 7 is a diagram illustrating haptic patterns according to anembodiment of the present invention;

FIG. 8 is a flowchart illustrating a terminal device controlling methodthat provides a haptic effect using a haptic engine according to anotherembodiment of the present invention;

FIGS. 9A and 9B illustrate screens that receive an input of selectionwith respect to at least one of an intensity and a duration of avibration pattern according to another embodiment of the presentinvention;

FIGS. 10A and 10B illustrate screens in which a haptic event occursaccording to another embodiment of the present invention;

FIGS. 11A and 11B are diagrams illustrating a haptic pattern accordingto another embodiment of the present invention;

FIG. 12 is a flowchart illustrating a terminal device controlling methodthat provides a haptic effect using a haptic engine according to anotherembodiment of the present invention;

FIG. 13 is a diagram illustrating a haptic pattern according to a firstembodiment of the present invention;

FIGS. 14A and 14B illustrate screens in which a haptic event occursaccording to a second embodiment and a third embodiment of the presentinvention, respectively; and

FIGS. 15A and 15B illustrate a haptic pattern according to the secondembodiment and the third embodiment of the present invention,respectively.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION

Various embodiments will now be described more fully with reference tothe accompanying drawings in which some example embodiments are shown.However, the embodiments do not limit the present disclosure to aspecific implementation, but should be construed as including allmodifications, equivalents, and replacements included in the spirit andscope of the present disclosure. For example, referring to FIG. 1, thehaptic engine 114 and the device driver 115 has been exemplified to beincluded in the controller 110, but the haptic engine 114 and the devicedriver 115 may be provided separate from the controller 110.

While terms including ordinal numbers, such as “first” and “second,”etc., may be used to describe various components, such components arenot limited by the above terms. The terms are used merely for thepurpose to distinguish an element from the other elements. For example,a first element could be termed a second element, and similarly, asecond element could be also termed a first element without departingfrom the scope of the present disclosure. As used herein, the term“and/or” includes any and all combinations of one or more of theassociated listed items.

The terms used in this application are for the purpose of describingparticular embodiments only and are not intended to limit thedisclosure. As used herein, the singular forms are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. Terms such as “include” and/or “have” may be construed todenote a certain characteristic, number, step, operation, constituentelement, component or a combination thereof, but may not be construed toexclude the existence of or a possibility of addition of one or moreother characteristics, numbers, steps, operations, constituent elements,components or combinations thereof.

Unless defined otherwise, all terms used herein have the same meaning ascommonly understood by those of skill in the art. Such terms as thosedefined in a generally used dictionary are to be interpreted to have themeanings equal to the contextual meanings in the relevant field of art,and are not to be interpreted to have ideal or excessively formalmeanings unless clearly defined in the present specification. It will befurther understood that terms, such as those defined in commonly useddictionaries, should be interpreted as having a meaning that isconsistent with their meaning in the context of the relevant art andwill not be interpreted in an idealized or overly formal sense unlessexpressly so defined herein.

FIG. 1 is a block diagram schematically illustrating a terminalapparatus according to an embodiment of the present invention.

Referring to FIG. 1, the apparatus 100 can be connected to an externaldevice (not shown) by using an external device connector such as a subcommunication module 130, a connector 165, and an earphone connectingjack 167. The “external device” includes various devices attached to ordetached from the apparatus 100 through a cable, such as an earphone, anexternal speaker, a Universal Serial Bus (USB) memory, a charger, acradle, a docking station, a DMB antenna, a mobile payment relateddevice, a health management device (blood sugar tester or the like), agame machine, a car navigation device and the like. Further, the“external device” may include a Bluetooth communication device, a shortdistance communication device such as a Near Field Communication (NFC)device, a WiFi Direct communication device, and a wireless Access Point(AC) which may be wirelessly connected to the apparatus 100. Inaddition, the external device may include another device, a mobilephone, a smart phone, a tablet PC, a desktop PC, and a server.

Referring to FIG. 1, the mobile apparatus 100 includes a display unitsuch as a touch screen 190 and a display controller such as a touchscreen controller 195. Further, the apparatus 100 includes a controller110, a mobile communication module 120, a sub communication module 130,a multimedia module 140, a camera module 150, a GPS module 155, aninput/output module 160, a sensor module 170, a storage unit 175, and apower supply unit 180. The sub communication module 130 includes atleast one of a wireless LAN module 131 and a short distancecommunication module 132, and the multimedia module 140 includes atleast one of a broadcasting communication module 141, an audio playbackmodule 142, and a video or motion picture playback module 143. Thecamera module 150 includes at least one of a first camera 151 and asecond camera 152. The input/output module 160 includes at least one ofa button 161, a microphone 162, a speaker 163, a vibrator 164, aconnector 165, a keypad 166, and an earphone connecting jack 167.Hereinbelow, descriptions will be made as to a case where the displayunit 190 and the display controller 195 are a touch screen and a touchscreen controller, respectively, by way of an example.

The controller 110 may include a CPU 111, a Read Only Memory (ROM) 112storing a control program for controlling the apparatus 100, and aRandom Access Memory (RAM) 113 used as a storage area for storing asignal or data input from the outside of the apparatus 100 or for anoperation performed in the apparatus 100. The CPU 111 may include asingle core, a dual core, a triple core, or a quad core. The CPU 111,the ROM 112 and the RAM 113 may be connected with each other throughinternal buses. Also the controller 110 may include a haptic engine 114and a device driver 115.

The controller 110 controls the mobile communication module 120, the subcommunication module 130, the multimedia module 140, the camera module150, the input/output module 160, the sensor module 170, the storageunit 175, the power supply unit 180, the touch screen 190, and the touchscreen controller 195.

The mobile communication module 120 enables the apparatus 100 to beconnected with an external device through mobile communication by usingone antenna or a plurality of antennas according to a control of thecontroller 110. The mobile communication module 120 transmits/receives awireless signal for a voice call, a video call, a Short Message Service(SMS), or a Multimedia Message Service (MMS) to/from a mobile phone, asmart phone, a tablet PC, or another device having a phone number inputinto the apparatus 100.

The sub-communication module 130 may include at least one of thewireless LAN module 131 and the local area communication module 132. Forexample, the sub-communication module 130 may include only the wirelessLAN module 131, only the local area communication module 132, or boththe wireless LAN module 131 and the local area communication module 132.

The wireless LAN module 131 may be Internet-connected in a place where awireless Access Point (AP) is installed according to a control of thecontroller 110. The wireless LAN module 131 supports a wireless LANstandard (IEEE802.11x) of the Institute of Electrical and ElectronicsEngineers (IEEE). The short distance communication module 132 maywirelessly perform short distance communication between the apparatus100 and an image forming apparatus according to a control of thecontroller 110. A short distance communication scheme may includeBluetooth, Infrared Data Association (IrDA) communication, WiFi-Directcommunication, Near Field Communication (NFC) and the like.

The apparatus 100 may include at least one of the mobile communicationmodule 120, the wireless LAN module 131, and the short distancecommunication module 132. For example, the apparatus 100 may include acombination of the mobile communication module 120, the wireless LANmodule 131, and the short distance communication module 132 according toa capability thereof.

The multimedia module 140 may include the broadcasting communicationmodule 141, the audio playback module 142 and the moving pictureplayback module 143. The broadcasting communication module 141 canreceive a broadcasting signal (for example, a TV broadcasting signal, aradio broadcasting signal, or a data broadcasting signal) andbroadcasting supplement information (for example, Electric Program Guide(EPG) or Electric Service Guide (ESG)) output from a broadcastingstation through a broadcasting communication antenna according to acontrol of the controller 110. The audio playback module 142 mayreproduce a digital audio file (for example, a file having a fileextension of mp3, wma, ogg, or wav) stored or received according to acontrol of the controller 110. The moving picture playback module 143may reproduce a stored or received digital moving image file (e.g., afile of which the file extension is mpeg, mpg, mp4, avi, mov, or mkv)according to the control of the control unit 110. The moving pictureplayback module 143 may reproduce a digital audio file.

The multimedia module 140 may include the audio playback module 142 andthe moving picture playback module 143 without the broadcastingcommunication module 141. Further, the audio playback module 142 or themotion picture playback module 143 of the multimedia module 140 may beincluded in the controller 110.

The camera module 150 may include at least one of the first camera 151and the second camera 152 each of which photographs a still image or amoving image according to the control of the control unit 110. Further,the first camera 151 or the second camera 152 may include an auxiliarylight source (for example, a flash providing light required for thephotographing. The first camera 151 may be disposed on a front surfaceof the apparatus 100, and the second camera 152 may be disposed on aback surface of the apparatus 100. In addition, the first camera 151 andthe second camera 152 may be disposed to be adjacent to each other (forexample, an interval between the first camera 151 and the second camera152 is larger than 1 cm or smaller than 8 cm), and thus athree-dimensional still image or a three-dimensional video may bephotographed.

The GPS module 155 may receive radio waves from a plurality of GPSsatellites in the Earth's orbit and calculate a position of theapparatus 100 by using Time of Arrival from the GPS satellites to theapparatus 100.

The button 161 of the input/output module 160 may be formed on a frontsurface, a side surface, or a back surface of a housing of the apparatus100, and may include at least one of a power/lock button, a volumebutton, a menu button, a home button, a back button, and a searchbutton.

The microphone 162 receives a voice or a sound to generate an electricalsignal according to a control of the controller 110. The speaker 163 mayoutput sounds corresponding to various signals (for example, a wirelesssignal, a broadcasting signal, a digital audio file, a digital videofile, taking a picture or the like) of the mobile communication module120, the sub communication module 130, the multimedia module 140, or thecamera module 150 to the outside of the apparatus 100 according to acontrol of the controller 110.

The speaker 163 may output a sound (for example, button tonecorresponding to a phone call or ringing tone) corresponding to afunction performed by the apparatus 100. One or more speakers 163 may beformed in a proper position or positions of the housing of the apparatus100.

The vibrator 164 converts an electronic signal to mechanical vibrationaccording to the control of the control unit 110, and may include avibration motor. For example, when the apparatus 100 in a vibration modereceives a voice call from another device, the vibrator 164 is operated.At least one vibrator 164 may be formed within a housing of the device100. The vibrator 164 may be operated in response to a user's touchaction on the touch screen 190 or a continuous touch movement on thetouch screen 190.

The connector 165 may be used as an interface for connecting theapparatus 100 with an external device or a power source. The apparatus100 may transmit or receive data stored in the storage unit 175 to orfrom an external device through a wired cable connected to the connector165 according to a control of the controller 110. The external devicemay be a docking station, and the data may be an input signaltransmitted from an external input device, for example, a mouse, akeyboard or the like. Further, the apparatus 100 may receive power froma power source through the wired cable connected to the connector 165 orcharge a battery by using the power source.

The keypad 166 may receive a key input from the user to control theapparatus 100. The keypad 166 includes a physical keypad formed on themobile apparatus 100 or a virtual keypad) displayed on the touch screen190. The physical keypad formed in the apparatus 100 may be omittedaccording to a capability or structure of the apparatus 100.

An earphone may be inserted into the earphone connecting jack 167 to beconnected with apparatus 100.

The sensor module 170 includes at least one sensor for detecting a stateof the apparatus 100. For example, the sensor module 170 includes atleast one of a proximity sensor for detecting whether the userapproaches the apparatus 100 and a luminance sensor for detecting anamount of ambient light of the apparatus 100. Also, the sensor module170 may include a gyro sensor. The gyro sensor may detect the operationof the mobile apparatus 100 (e.g., rotation of the mobile apparatus 100,or acceleration or vibration applied to the mobile apparatus 100), maydetect a point of the compass using the magnetic field on Earth, or maydetect a gravity acting direction. Further, the sensor module 170includes an altimeter for measuring an atmospheric pressure to detect analtitude. At least one of the sensors can detect the state, generate asignal corresponding to the detection, and transmit the generated signalto the controller 110. At least one of the sensors of the sensor module170 may be added or omitted according to the capability of the apparatus100.

The storage unit 175 stores signals or data input/output in response tothe operations of the mobile communication module 120, thesub-communication module 130, the multimedia module 140, the cameramodule 150, the GPS module 155, the input/output module 160, the sensormodule 170, and the touch screen 190 according to the control of thecontrol unit 110. The storage unit 175 stores a control program andapplications for controlling the apparatus 100 or the controller 110.The term “storage unit” includes the storage unit 175, the ROM 112 andthe RAM 113 within the controller 110, or a memory card (for example, anSD card or a memory stick) installed in the apparatus 100. The storageunit may include a non-volatile memory, a volatile memory, an HDD (HardDisc Drive) or an SSD (Solid State Drive).

The power supply unit 180 supplies power to one or more batteriesarranged in the housing of the apparatus 100 according to a control ofthe controller 110. The one or more batteries supply power to theapparatus 100. Further, the power supply unit 180 may supply power inputfrom an external power source through a wired cable connected to theconnector 165 to the apparatus 100. In addition, the power supply unit180 may supply power wirelessly input from the external power sourcethrough a wireless charging technology to the apparatus 100.

The touch screen 190 provides a user interface corresponding to variousservices (for example, phone communication, data transmission,broadcasting, and photographing a picture) to the user. The touch screen190 transmits an analog signal corresponding to at least one touch inputinto the user interface to the touch screen controller 195. The touchscreen 190 may receive at least one touch through a body part of theuser (for example, the fingers) or a touchable input means. Also, thetouch screen 190 may receive a continuous motion of one touch. The touchscreen 190 transmits an analog signal corresponding to the continuousmovement of the touch input thereto to the touch screen controller 195.

Herein, the touch is not limited to a contact between the touch screen190 and the user's body or a touchable input means and may include acontactless touch. The detectable interval of the touch screen 190 maybe changed according to a capability or structure of the portableterminal 100.

The touch screen 190 may be implemented in, for example, a resistivetype, a capacitive type, an infrared type, or an acoustic wave type.

The touch screen controller 195 converts the analog signal received fromthe touch screen 190 to a digital signal (for example, X and Ycoordinates) and transmits the digital signal to the controller 110. Thecontroller 110 may control the touch screen 190 by using the digitalsignal received from the touch screen controller 195. For example, thecontrol unit 110 may cause a shortcut icon displayed on the touch screen190 to be selected or may execute the shortcut icon in response to atouch. Further, the touch screen controller 195 may be included in thecontroller 110.

FIG. 2 is a front perspective view of a terminal apparatus according toan embodiment of the present invention. FIG. 3 is a rear perspectiveview of the terminal apparatus.

Referring to FIG. 2, a touch screen 190 is arranged at the center of thefront surface 100 a of the terminal apparatus 100. The touch screen 190is formed in a large size so that the touch screen 190 occupies almostall the front surface 100 a of the mobile apparatus 100. FIG. 2 shows anexample where a main home screen is displayed on the touch screen 190.The main home screen is the first screen displayed on the touch screen190 when the mobile apparatus 100 is turned ON. When the mobileapparatus 100 includes a plurality of pages of different home screens,the main home screen may be the first home screen among the plurality ofpages of home screens. Short-cut icons 191-1, 191-2, and 191-3 forexecuting frequently used applications, an application switching key191-4, time, weather and the like may be displayed on the home screen.The application switching key 191-4 displays on the screen applicationicons that indicate applications on the touch screen 190. At the top endof the touch screen 190, a status bar 192 may be formed that indicatesthe status of the mobile apparatus 100 such as the battery chargestatus, the intensity of a received signal, and current time.

A home button 161 a, a menu button 161 b, and a back button 161 c may beformed at the lower part of the touch screen 190.

The home button 161 a displays the main home screen on the touch screen190. For example, when the home button 161 a is pressed (or touched) ina state where any home screen different from the main home screen or amenu screen is displayed on the touch screen 190, the main home screenis displayed on the touch screen 190. In addition, when the home button161 a is pressed (or touched) while an application is being executed onthe touch screen 190, the main home screen illustrated in FIG. 2 isdisplayed on the touch screen 190. In addition, the home button 161 amay be used to display recently used applications or a task manager onthe touch screen 190.

The menu button 161 b provides a connection menu which can be used onthe touch screen 190. The connection menu includes a widget additionmenu, a background changing menu, a search menu, an editing menu, anenvironment setup menu and the like. In addition, when an application isexecuted, the menu button 161 b may provide a connection menu connectedto the application.

The back button 161 c can be used for displaying the screen which wasexecuted just before the currently executed screen or terminating themost recently used application.

The first camera 151, an illumination sensor 170 a, and a proximitysensor 170 b may be disposed on edges of the front surface 100 a of theapparatus 100. The second camera 152, the flash 153, and the speaker 163may be disposed on a rear surface 100 c of the apparatus 100, as shownin FIG. 3.

On the side surfaces 100 b of the mobile apparatus 100, for example, apower/reset button 161 d, a volume button 161 e, a terrestrial DMBantenna 141 a that receives broadcasting, and one or more microphones162 may be arranged. The DMB antenna 141 a may be formed to be fixed ordetachably mounted on the mobile apparatus 100.

Further, the connector 165 is formed on a lower side surface of theapparatus 100. A plurality of electrodes are formed in the connector165, and the connector 165 may be connected to an external devicethrough a wire. The earphone connecting jack 167 may be formed on anupper side surface of the apparatus 100. An earphone may be insertedinto the earphone connecting jack 167.

FIG. 4 is a flowchart illustrating a terminal device controlling methodthat provides a haptic effect using a haptic engine according to anembodiment of the present invention.

Referring to FIG. 4, the terminal device controlling method thatprovides a haptic effect using a haptic engine senses a haptic event instep 1010, according to the controller 110 of the terminal device 100.The haptic event may be designated in advance and stored in the storageunit 175. The haptic event may occur in an application that is beingexecuted in the terminal device 100. For example, the haptic event mayoccur while a game application is executed.

FIGS. 5A and 5B illustrate screens in which a haptic event occursaccording to an embodiment of the present invention. Referring to FIG.5, a game application is executed in the terminal device 100, such as,for example, a car racing game. In this example, the haptic event may bea collision between cars in the game that may occur while the car racinggame application is executed. That is, the haptic event may correspondto a collision event. For example, as shown in FIG. 5A, a collisionevent between a first car 201 and a second car 202 may be an example ofthe haptic event. As described above, the collision event correspondingto the haptic event may be designated in advance and may be stored inthe storage unit 175. Therefore, the controller 110 may sense that thecollision event corresponding to the haptic event has occurred.

Referring back to FIG. 4, subsequently, the method executes anon-physical parameter-based haptic function in the haptic engine so asto determine a vibration pattern corresponding to the haptic event instep 1020. The controller 110 controls the haptic engine so as toexecute the non-physical parameter-based haptic function in the hapticengine, and determines the vibration pattern corresponding to the hapticevent. In this example, the haptic function may be a non-physicalparameter-based haptic function or a physical parameter-based hapticfunction. The non-physical parameter-based haptic function indicates ahaptic function that is used for a haptic event that occurs in anenvironment that is different from a physical environment. The physicalparameter-based haptic function indicates a haptic function that is usedfor a haptic event that occurs in a physical environment. The term“physical environment” refers to an environment where the haptic eventmay occur in the real world according to the laws of physics, whereasthe term “non-physical environment” refers to an environment that doesnot correspond to the physical environment.

The non-physical parameter-based haptic function may be determinedthrough at least one classification. In this example, the non-physicalparameter based haptic function may be determined through a broadclassification, an intermediate classification, and a fineclassification. For example, the non-physical parameter-based hapticfunction may be determined to be HapticNP(V1, V2, V3). HapticNP(V1, V2,V3) indicates a non-physical parameter-based haptic function. V1 denotesa parameter of a broad classification, V2 denotes a parameter of anintermediate classification, and V3 denotes a parameter of a fineclassification. The broad classification, the intermediateclassification, and the fine classification, may be classified, forexample, as shown in Table 1.

TABLE 1 Broad Intermediate Fine Fine classification classificationClassification 1 Classification 2 Example Collision A between hard aweight: a1 impact: H/M/L a objects light object H/M/L baseball and a batheavy object a2 between cars between hard b weight: b1 impact: H/M/L andsoft light object H/M/L objects heavy object b2 Fire B pistol a impact:H/M/L H/M/L big gun b impact: H/M/L H/M/L Cannon c impact: H/M/L H/M/L

Referring to Table 1, the at least one classification includes a broadclassification for determining a function, an intermediateclassification for determining a detailed category, and a fineclassification for determining selection of a situation. For example, asshown in Table 1, the broad classification may determine a function of ahaptic event such as ‘collision’ and ‘fire’. The intermediateclassification may determine a detailed category of the broadclassification, such as, “between hard objects (a)” and “between hardand soft objects (b)”. The fine classification may determine selectionof a situation such as a situation in which a weight is heavy, asituation in which a weight is light, or a situation in which an impactis heavy/medium/light (H/M/L).

Referring to Table 1, the non-physical parameter-based haptic functionmay be classified through a broad classification, for example,“collision (A)”, “fire (B)”, and the like. The broad classification suchas “collision (A)” may be classified through an intermediateclassification such as “between hard objects(a)” and “between hard andsoft objects (b)”. The intermediate classification may be classifiedthrough a fine classification such as “a situation in which an object islight (a1)” and “a situation in which an object is heavy (a2)”. Also,the intermediate classification may be classified through a fineclassification such as “a situation in which an impact is H/M/L”.

Also, the broad classification such as “fire (B)” may be classifiedthrough an intermediate classification such as a “pistol (a)”, a “biggun(b)”, and a “cannon(c)”. The intermediate classification may beclassified through a fine classification such as “a situation in whichan impact is H/M/L”.

For example, when the broad classification is “collision (A)”, theintermediate classification is “between hard objects (a)”, and the fineclassification is “a situation in which an object is light(a1)”, thenon-physical parameter-based haptic function may be determined to beHapticNP(A, a, a1).

As another example, when the broad classification is “fire(B)”, theintermediate classification is “cannon (c)”, and the fine classificationis “a situation in which an impact is ‘M’”, the non-physicalparameter-based haptic function may be determined to be HapticNP(B, c,M).

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern.That is, the storage unit 175 stores a predetermined haptic patterncorresponding to the non-physical parameter-based haptic functiondetermined through the at least one classification. For example, whenthe non-physical parameter-based haptic function determined through theat least one classification is HapticNP(A, a, a1), a predeterminedhaptic pattern corresponding to the non-physical parameter-based hapticfunction HapticNP(A, a, a1) may be stored in the storage unit 175. Forexample, the haptic pattern may be a haptic pattern illustrated in FIG.6. Referring to FIG. 6, the haptic pattern may be formed having avertical axis indicating an intensity (I) and a horizontal axisindicating a duration (t). That is, the haptic pattern illustrated inFIG. 6 corresponds to a haptic pattern of which an intensity of avibration gradually increases from 0 to I during a time from 0 to t. Thehaptic pattern may include a frequency (f). Therefore, the hapticpattern corresponds to the frequency (f), and has a vibration of whichan intensity gradually increases from 0 to I during a time from 0 to t.

The haptic pattern may be a combination of a plurality of predeterminedhaptic patterns. FIG. 7 illustrates haptic patterns. In FIG. 7, hapticpatterns A1, A2, and A3 correspond to a plurality of predeterminedhaptic patterns. Haptic patterns B1 through C3 correspond to hapticpatterns formed of a combination of the plurality of predeterminedhaptic patterns. Referring to FIG. 7, haptic pattern A1 is a hapticpattern provided in a rectangular shape, haptic pattern A2 is a hapticpattern provided in a right triangular shape of which an intensitygradually increases over time, and the haptic pattern A3 is a hapticpattern provided in a right triangular shape of which an intensitygradually decreases over time. In this example, the haptic patterns B1through C3 may be formed of a combination of the plurality ofpredetermined haptic patterns. For example, the haptic pattern B1 isformed of a combination of the haptic pattern A2 and the haptic patternA3. As another example, the haptic pattern C1 is formed of two hapticpattern A1s.

In this example, the controller 110 determines a frequency or a hapticpattern based on the intermediate classification, and determines anintensity or a duration based on the fine classification. That is, afrequency or a haptic pattern predetermined based on the intermediateclassification may be determined, and an intensity or a durationpredetermined based on the fine classification may be determined. Forexample, when the non-physical parameter-based haptic function isHapticNP(A, a, a1), the intermediate classification is “between hardobjects (a)” and the fine classification is “a situation in which anobject is light (a1)”. In this example, a frequency and a haptic patternthat are predetermined based on the intermediate classification thatreads “between hard object (a)” may be “60” and the haptic pattern ofFIG. 6, respectively. An intensity and a duration that are predeterminedbased on the fine classification that reads “a situation in which anobject is light (a1)” may be “10” and “5 seconds”, respectively.Therefore, the controller 110 may determine the vibration patterncorresponding to the haptic event, based on the predetermined frequency,haptic pattern, intensity, or duration.

Briefly, the controller 110 controls the haptic engine so as to executethe non-physical parameter-based haptic function, and determines thehaptic pattern. In this example, the non-physical parameter-based hapticfunction may be determined through at least one classification, such as,a broad classification, an intermediate classification, and a fineclassification. The non-physical parameter-based haptic function mayhave a predetermined haptic pattern. In this example, a frequency or ahaptic pattern predetermined based the intermediate classification maybe determined, and an intensity or a duration predetermined based on thefine classification may be determined. Therefore, the controller 110executes the non-physical parameter-based haptic function so as todetermine an intensity, a duration, and a frequency with respect to thedetermined haptic pattern, and determines the vibration patterncorresponding to the haptic event.

Therefore, according to an embodiment of the present disclosure, thepresent invention has an advantage of determining a vibration patterncorresponding to a haptic event by executing a non-physicalparameter-based haptic function in a haptic engine.

Referring again to FIG. 4, the method then transfers the vibrationpattern from the haptic engine to the device driver in step Thecontroller 110 transfers the vibration pattern determined in the hapticengine to the device driver.

A haptic effect is embodied by driving a vibrator through the devicedriver based on the vibration pattern in step 1040. The controller 110controls the device driver to drive the vibrator 164 based on thevibration pattern and embodies a haptic effect. For example, asillustrated in FIG. 5B, the controller 110 controls the device driver todrive the vibrator 164 based on the vibration pattern corresponding tothe haptic event received from the haptic engine, and embodies a hapticeffect by vibrating the terminal device 100. That is, as illustrated inFIG. 5B, the vibrator 164 is driven based on a vibration patterncorresponding to a collision event occurring while the car racing gameapplication is executed, so that a haptic effect is embodied byvibrating the terminal device 100.

FIG. 8 is a flowchart of a terminal device controlling method thatprovides a haptic effect using a haptic engine according to anotherembodiment of the present invention.

Referring to FIG. 8, an input of selection with respect to at least oneof an intensity and a duration of a vibration pattern is received instep 1100. The controller 110 may receive an input of selection withrespect to at least one of an intensity and a duration of a vibrationpattern through the input/output module 160, or for example, through thetouch screen 190.

FIGS. 9A and 9B illustrate screens that receive an input of selectionwith respect to an intensity and a duration of a vibration patternaccording to another embodiment of the present invention. Referring toFIG. 9A, intensities and durations of vibration patterns that areclassified as a “pistol”, a “big gun”, and a “cannon” which belong to“fire” among haptic events may be received through the touch screen 190.That is, a user may input the intensities and the durations of thevibration patterns that are classified as the “pistol”, the “big gun”,and the “cannon” which belong to “fire”, into the touch screen 190through a touch, so that the user may directly select a desiredintensity and duration of a vibration pattern. For example, as shown inFIG. 9B, an intensity and a duration of a vibration pattern for the“pistol” included in “fire” may be input as “8” and “0.5 seconds”,respectively. An intensity and a duration of a vibration pattern for the“big gun” may be input as “15” and “1 second”, respectively. Anintensity and a duration of a vibration pattern for the “cannon” may beinput as “30” and “2 seconds”, respectively.

Referring back to FIG. 8, the method then senses a haptic event in step1110, where the controller 110 of the terminal device 100 senses thehaptic event. The haptic event is designated in advance and is stored inthe storage unit 175. Therefore, the controller 110 senses the hapticevent designated in advance from the storage unit 175. The haptic eventmay occur in an application that is being executed in the terminaldevice 100. For example, the haptic event may occur while the gameapplication is executed.

FIGS. 10A and 10B illustrate screens in which a haptic event occursaccording to another embodiment of the present invention. Referring toFIG. 10, a game application is executed in the terminal device 100. Forexample, the haptic event may correspond to a big gun firing event thatmay occur while the game application is executed, as illustrated in FIG.10A. As described above, the big gun firing event corresponding to thehaptic event may be designated in advance and may be stored in thestorage unit 175. Therefore, the controller 110 senses that the big gunfiring event corresponding to the haptic event occurs.

The method then executes the non-physical parameter-based hapticfunction in the haptic engine and determines a vibration patterncorresponding to the haptic event in step 1120. The controller 110controls the haptic engine to execute a non-physical parameter basedhaptic function in the haptic engine, and determines a vibration patterncorresponding to the haptic event.

The non-physical parameter-based haptic function may be determinedthrough at least one classification. In this example, the non-physicalparameter-based haptic function may be determined through a broadclassification, an intermediate classification, and a fineclassification. For example, the non-physical parameter-based hapticfunction may be determined to be HapticNP(V1, V2, V3). V1 indicates aparameter of a broad classification, V2 indicates a parameter of anintermediate classification, and V3 indicates a parameter of a fineclassification.

The at least one classification includes a broad classification fordetermining a function, an intermediate classification for determining adetailed category, and a fine classification for determining selectionof a situation. For example, the non-physical parameter-based hapticfunction classified as a broad classification, for example, “fire(B)”may be classified through an intermediate classification, such as, a“pistol (a)”, a “big gun (b)”, and a “cannon (c)”. The intermediateclassification may be classified through a fine classification, such as“a situation in which an impact is H/M/L”.

When the broad classification is “fire (B)”, the intermediateclassification is the “big gun (b)”, and the fine classification is “H”,the non-physical parameter-based haptic function may be determined to beHapticNP(B, b, H).

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern, andmay be stored in the storage unit 175. When the non-physicalparameter-based haptic function determined through the at least oneclassification is HapticNP(B, b, H), the predetermined haptic patterncorresponding to the non-physical parameter-based haptic functionHapticNP(B, b, H) may be stored in the storage unit 175. For example,the haptic pattern may be a haptic pattern illustrated in FIG. 11A.Referring to FIG. 11A, the haptic pattern may be formed of a verticalaxis of an intensity (I), and a horizontal axis of a duration (t). Thatis, the haptic pattern illustrated in FIG. 11A corresponds to a hapticpattern of which an intensity of a vibration gradually decreases from Ito 0 during a time from 0 to t. The haptic pattern may include afrequency (f). Therefore, the haptic pattern corresponds to a frequency(f), and has a vibration of which an intensity gradually decreases fromI to 0 during a time from 0 to t.

In this example, the controller 110 determines the vibration patterncorresponding to the haptic event using at least one of the inputintensity and duration of the vibration pattern. For example, asdescribed above, the input intensity and duration of the vibrationpattern may be “15” and “1 second”, respectively. The controller 110 maydetermine a haptic pattern corresponding to a frequency (f) of which anintensity of a vibration gradually decreases from 15 to 0 during a timefrom 0 to 1 second, as the vibration pattern, to correspond to the biggun firing event. The controller 110 uses the intensity and duration ofthe vibration pattern input for the haptic pattern of FIG. 11A, that is,“15” and “1 second”, so as to determine, as the vibration pattern, thehaptic pattern corresponding to a frequency (f) of which an intensity ofa vibration gradually decreases from 15 to 0 during a time from 0 to 1second, as illustrated in FIG. 11B. Therefore, the vibration patterncorresponding to the “big gun firing event” of FIG. 10A may bedetermined as shown in FIG. 11B.

Referring back to FIG. 8, the method then transfers the vibrationpattern from the haptic engine to the device driver in step 1130. Thecontroller 110 transfers the vibration pattern determined in the hapticengine to the device driver. In step 1140, the device driver drives thevibrator based on the vibration pattern, and embodies a haptic effect.The controller 110 controls the device driver to drive the vibrator 164based on the vibration pattern, and embodies a haptic effect. Forexample, as illustrated in FIG. 10B, the controller 110 controls thedevice driver and drives the vibrator 164 based on the vibration patterncorresponding to the haptic event received from the haptic engine, andembodies a haptic effect by vibrating the terminal device 100. That is,as illustrated in FIG. 10A, the vibrator 164 is driven based on thevibration pattern corresponding to the big gun firing event occurringwhile the game application is executed, the terminal device 100 isvibrated, and a haptic effect may be embodied.

Therefore, the present invention receives an input of selection withrespect to at least one of an intensity and a duration of a vibrationpattern, determines a vibration pattern through applying at least one ofthe input intensity and duration of the vibration pattern to a hapticpattern corresponding to a haptic event, and drives a vibrator based onthe determined vibration pattern.

FIG. 12 is a flowchart of a terminal device controlling method thatprovides a haptic effect using a haptic engine according to anotherembodiment of the present invention.

Referring to FIG. 12, a haptic event is sensed in step 1310 by thecontroller 110 of the terminal device 100. The haptic event may bedesignated in advance and stored in the storage unit 175. Therefore, thecontroller 110 may sense the haptic event designated in advance from thestorage unit 175. The haptic event may occur in an application that isbeing executed in the terminal device 100. The haptic event maycorrespond to a collision event in a game application and may bedesignated in advance and stored in the storage unit 175. Therefore, thecontroller 110 senses that the collision event corresponding to thehaptic event occurs.

The method then determines whether the haptic event is based on aphysical parameter in step 1312. In this example, the haptic event maybe based on a physical parameter, or may be based on a non-physicalparameter. When the haptic event occurs in a physical environment, itindicates that the haptic event is based on a physical parameter.Conversely, when the haptic event occurs in a non-physical environment,it indicates that the haptic event is based on a non-physical parameter.In this example, the physical environment refers to an environment wherethe haptic event may occur in the real world according to the laws ofphysics, whereas the non-physical environment refers to an environmentthat does not correspond to the physical environment.

In this example, the controller 110 calls a physical parameter-basedhaptic function when the haptic event is based on a physical parameterin step 1314. Conversely, the controller 110 calls a non-physicalparameter-based haptic function when the haptic event is not based on aphysical parameter in step 1316.

When the haptic event is based on a physical parameter, the method callsthe physical parameter-based function to execute the physicalparameter-based haptic function in the haptic engine, and determines avibration pattern corresponding to the haptic event in step 1320. Thephysical parameter-based haptic function may be determined through atleast one classification. For example, the physical parameter-basedhaptic function may be determined to be HapticP(Impulse, e, d, k1, k2,r). HapticP denotes a physical parameter-based haptic function.“Impulse” corresponds to a quantity of an impulse, and denotes mΔv. Inthis example, m denotes a mass, and v denotes a velocity. Also, “e”denotes a type of an event, and indicates a type of collision and a typeof vibration. “d” denotes a detailed attribute of the event. “k1” and“k2” denote criterion values for determining a soft object and a hardobject. “r” denotes a number of repetitions.

Conversely, when the haptic event is based on a non-physical parameter,the method calls the non-physical parameter-based haptic function instep 1316 so as to execute the non-physical parameter-based hapticfunction in the haptic engine, and determines a vibration patterncorresponding to the haptic event in step 1322. Here, the method ofdetermining the vibration pattern corresponding to the haptic event byexecuting the non-physical parameter-based haptic function in the hapticengine is identical to the description that has been provided withreference to step 1020 of FIG. 4 and thus, it will be generallydescribed. That is, the controller 110 controls the haptic engine so asto execute the non-physical parameter-based haptic function in thehaptic engine, and determines the vibration pattern corresponding to thehaptic event.

The non-physical parameter-based haptic function may be determinedthrough at least one classification. In this example, the non-physicalparameter-based haptic function may be determined through a broadclassification, an intermediate classification, and a fineclassification. For example, the non-physical parameter based hapticfunction may be determined to be HapticNP(V1, V2, V3). HapticNP denotesa non-physical parameter-based haptic function, V1 denotes a parameterof a broad classification, V2 denotes a parameter of an intermediateclassification, and V3 denotes a parameter of a fine classification.

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern.That is, the predetermined haptic pattern corresponding to thenon-physical parameter-based haptic function determined through the atleast one classification may be stored in the storage unit 175. Thehaptic pattern may be a combination of a plurality of predeterminedhaptic patterns, as previously described.

In this example, the controller 110 may determine a frequency or ahaptic pattern based on the intermediate classification, and maydetermine an intensity or a duration based on the fine classification.Therefore, the controller 110 determines an intensity, a duration, and afrequency with respect to the haptic pattern determined by executing thenon-physical parameter-based haptic function, and determines thevibration pattern corresponding to the haptic event.

In FIG. 12, the method then transfers the vibration pattern from thehaptic engine to the device driver in step 1330. The controller 110transfers the vibration pattern determined in the haptic engine to thedevice driver.

The device driver then drives the vibrator based on the vibrationpattern and embodies a haptic effect in step 1340. The controller 110controls the device driver to drive the vibrator 164 based on thevibration pattern, and embodies a haptic effect.

Therefore, whether a haptic event is based on a physical parameter or anon-physical parameter is determined. A physical parameter-based hapticfunction is called when the haptic event is based on the physicalparameter, and a non-physical parameter-based haptic function is calledwhen the haptic event is not based on a physical parameter.

A terminal device controlling method that provides a haptic effect usinga haptic engine will be described according to a first embodiment of thepresent disclosure.

Referring again to FIG. 8, in step 1100, the controller 110 receives aninput of selection with respect to at least one of an intensity and aduration of a vibration pattern. That is, the controller 110 may receivean input of selection with respect to at least one of an intensity and aduration of a vibration pattern through the input/output module 160, orfor example, through the touch screen 190. An input of an intensity anda duration of a vibration pattern of “included in” “pit-a-” of “feeling”may be received through the touch screen 190. For example, the intensityand the duration of the vibration pattern of “tension” included in“pit-a-pat” of “feeling” may be input as “10” and “2 seconds”,respectively.

Subsequently, a haptic event is sensed in step 1110 by controller 110 ofthe terminal device 100. The haptic event may be designated in advanceand stored in the storage unit 175. Therefore, the controller 110 maysense the haptic event designated in advance from the storage unit 175.The haptic event may occur in an application that is being executed inthe terminal device 100, such as a game application. For example, thehaptic event may be a tension generating event that may occur while thegame application is executed. As described above, the tension generatingevent corresponding to the haptic event may be designated in advance andstored in the storage unit 175. Therefore, the controller 110 may sensethat the tension generating event corresponding to the haptic eventoccurs.

In step 1120, a non-physical parameter-based haptic function isexecuted, and a vibration pattern is determined corresponding to thehaptic event. The controller 110 controls the haptic engine to execute anon-physical parameter-based haptic function in the haptic engine, anddetermines a vibration pattern corresponding to the haptic event.

The non-physical parameter-based haptic function may be determinedthrough at least one classification, including a broad classification,an intermediate classification, and a fine classification. That is, thebroad classification determines a function, the intermediateclassification determines a detailed category, and the fineclassification determines selection of a situation. For example, thenon-physical parameter-based haptic function classified as the broadclassification such as “feeling (C)” may be classified through theintermediate classification such as “pit-a-pat (b)”. The intermediateclassification may be classified through the fine classification such as“tension (c)”. The non-physical parameter-based haptic function may bedetermined to be, for example, HapticNP(C, b, c).

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern.That is, a predetermined haptic pattern corresponding to thenon-physical parameter based haptic function determined through the atleast one classification may be stored in the storage unit 175. Forexample, when the non-physical parameter based haptic functiondetermined through the at least one classification is HapticNP(C, b, c),a predetermined haptic pattern corresponding to HapticNP(C, b, c) may bestored in the storage unit 175. For example, the haptic pattern may be ahaptic pattern illustrated in FIG. 13. Referring to FIG. 13, the hapticpattern may be formed of a vertical axis of an intensity (I) and ahorizontal axis of a duration (t). The haptic pattern is formed of anintensity of I during a time of t1, an intensity of 0 during a time oft2, an intensity of I during a time of subsequent t1, an intensity of 0during a time of t3, and an intensity of I during a time of subsequentt1. The haptic pattern may include a frequency (f).

In this example, the controller 110 may determine the vibration patterncorresponding to the haptic event using at least one of the inputintensity and duration of the vibration pattern. For example, asdescribed above, the input intensity and duration of the vibrationpattern may be “10” and “2 seconds”, respectively. The controller 110determines, as the vibration pattern during a total of 2 seconds, ahaptic pattern corresponding to a frequency (f) that is formed of anintensity of 10 during a time of t1, an intensity of 0 during a time oft2, an intensity of 10 during a time of subsequent t1, an intensity of 0during a time of t3, and an intensity of 10 during a time of subsequentt1, to correspond to the tension generating event. Therefore, thevibration pattern of FIG. 13 may be determined to correspond to the“tension generating event”.

In step 1130, the vibration pattern is transferred from the hapticengine to a device driver. The controller 110 transfers the vibrationpattern determined in the haptic engine to the device driver.

The device driver then drives the vibrator based on the vibrationpattern, and embodies a haptic effect in step 1140, under control of thecontroller 110. That is, the vibrator 164 is driven based on thevibration pattern corresponding to the tension generating eventoccurring while the game application is executed, the terminal device100 is vibrated, and a haptic effect may be embodied.

Therefore, according to the first embodiment, a haptic effect isembodied by receiving an input of selection with respect to at least oneof an intensity and a duration of a vibration pattern, determining avibration pattern through applying at least one of the input intensityand duration of the vibration pattern to a haptic pattern correspondingto a haptic event, such as “a tension generating event”, and driving avibrator based on the determined vibration pattern.

A terminal device controlling method that provides a haptic effect usinga haptic engine according to a second embodiment of the presentinvention will be described.

Referring again to FIG. 8, an input of selection with respect to atleast one of an intensity and a duration of a vibration pattern isreceived in step 1100. The controller 110 receives an input of selectionwith respect to at least one of an intensity and a duration of avibration pattern, through the input/output module 160, or for example,through the touch screen 190. An input of an intensity and a duration ofa vibration pattern of “between hard objects” included in “collision”from among haptic events may be received through the touch screen 190.For example, the intensity and the duration of the vibration pattern of“between hard objects” included in “collision” may be input as “5” and“0.5 seconds”, respectively.

Subsequently, a haptic event is sensed in step 1110 by the controller110 of the terminal device 100. The haptic event is designated inadvance and stored in the storage unit 175, and the controller 110 maysense the haptic event designated in advance from the storage unit 175.The haptic event may occur in an application that is being executed inthe terminal device 100. For example, the haptic event may be acollision event between hard objects that may occur while the gameapplication is executed. For example, the collision event between hardobjects may be a collision event between billiard balls 301 and 302, asillustrated in FIG. 14A.

The method then executes a non-physical parameter-based haptic function,and determines a vibration pattern corresponding to the haptic event instep 1120. The controller 110 controls the haptic engine to execute anon-physical parameter-based haptic function in the haptic engine, anddetermines a vibration pattern corresponding to the haptic event.

The non-physical parameter-based haptic function may be determinedthrough at least one classification. In this example, the non-physicalparameter based haptic function may be determined through a broadclassification for determining a function, and an intermediateclassification for determining a detailed category. For example, thenon-physical parameter-based haptic function classified as the broadclassification such as “collision (F)” may be classified through theintermediate classification such as “between hard objects (B8)”. Thenon-physical parameter based haptic function may be determined to be,for example, HapticNP(F, B8).

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern,which may be stored in the storage unit 175. For example, when thenon-physical parameter-based haptic function determined through the atleast one classification is HapticNP(F, B8), a predetermined hapticpattern corresponding to the non-physical parameter-based hapticfunction HapticNP(F, B8) may be stored in the storage unit 175. Forexample, the haptic pattern may be a haptic pattern illustrated in FIG.15A. Referring to FIG. 15A, the haptic pattern may be formed of avertical axis of an intensity (I) and a horizontal axis of a duration(t). The haptic pattern has an intensity of I during a time of t1, andthe intensity decreases from I to 0 during a time of t2. The hapticpattern may include a frequency (f).

In this example, the controller 110 determines the vibration patterncorresponding to the haptic event using at least one of the inputintensity and duration of the vibration pattern. For example, asdescribed above, the input intensity and duration of the vibrationpattern may be “5” and “0.5 seconds”, respectively. The controller 110determines, as the vibration pattern during a total of 0.5 seconds, ahaptic pattern corresponding to a frequency (f) that has an intensity of5 during a time of t1, and an intensity that decreases from 5 to 0during a time of t2, to correspond to the collision event between thehard objects. Therefore, the vibration pattern of FIG. 15A may bedetermined to correspond to the “collision event between hard objects”.

Subsequently, the vibration pattern is transferred from the hapticengine to a device driver in step 1130. The controller 110 transfers thevibration pattern determined in the haptic engine to the device driver.

The device driver then drives the vibrator based on the vibrationpattern, and embodies a haptic effect in step 1140. The controller 110controls the device driver to drive the vibrator 164 based on thevibration pattern, and embodies a haptic effect. That is, the vibrator164 is driven based on the vibration pattern corresponding to the“collision event between hard objects” occurring while the gameapplication is executed, the terminal device 100 is vibrated, and ahaptic effect may be embodied.

Therefore, according to the second embodiment a haptic effect isembodied by receiving an input of selection with respect to at least oneof an intensity and a duration of a vibration pattern, determining avibration pattern by applying at least one of the input intensity andduration of the vibration pattern to a haptic pattern corresponding to ahaptic event such as a “collision event between hard objects”, anddriving a vibrator based on the determined vibration pattern.

A terminal device controlling method that provides a haptic effect usinga haptic engine according to a third embodiment of the present inventionwill be described.

Referring again to FIG. 8, an input of selection with respect to atleast one of an intensity and a duration of a vibration pattern isreceived in step 1100. The controller 110 receives an input of selectionwith respect to at least one of an intensity and a duration of avibration pattern, through the input/output module 160, or for example,through the touch screen 190. An input of an intensity and a duration ofa vibration pattern of “between hard and soft objects” included in“collision” from among haptic events may be received through the touchscreen 190, and may be, for example, input as “3” and “0.4 seconds”,respectively.

A haptic event is sensed in step 1110. The controller 110 of theterminal device 100 senses a haptic event. The haptic event isdesignated in advance and stored in the storage unit 175, and thecontroller 110 may sense the haptic event designated in advance from thestorage unit 175. The haptic event may occur in a game application thatis being executed in the terminal device 100. For example, the hapticevent may be a collision event between hard and soft objects that mayoccur while the game application is executed. For example, the“collision event between hard soft objects” may be a collision eventbetween a baseball 312 and a bat 311, as illustrated in FIG. 14B.

A non-physical parameter-based haptic function in the haptic engine isexecuted, and a vibration pattern corresponding to the haptic event isdetermined in step 1120. The controller 110 controls the haptic engineto execute a non-physical parameter-based haptic function in the hapticengine, and determines a vibration pattern corresponding to the hapticevent.

The non-physical parameter based haptic function may be determinedthrough at least one classification. In this example, the non-physicalparameter based haptic function may be determined through a broadclassification for determining a function, and an intermediateclassification for determining a detailed category. For example, thenon-physical parameter-based haptic function classified as the broadclassification such as “collision (F)” may be classified through theintermediate classification such as “between hard and soft objects(B7)”. The non-physical parameter-based haptic function may bedetermined to be, for example, HapticNP(F, B7).

The non-physical parameter-based haptic function determined through theat least one classification may have a predetermined haptic pattern, andmay be stored in the storage unit 175. For example, when thenon-physical parameter-based haptic function determined through the atleast one classification is HapticNP(F, B7), a predetermined hapticpattern corresponding to the non-physical parameter-based hapticfunction HapticNP(F, B7) may be stored in the storage unit 175. Forexample, the haptic pattern may be a haptic pattern illustrated in FIG.15B. Referring to FIG. 15B, the haptic pattern may be formed of avertical axis of an intensity (I) and a horizontal axis of a duration(t). The haptic pattern has an intensity that increases from I0 to 0Iduring a time of t2, and has an intensity of I during a time of t1. Thehaptic pattern may include a frequency (f).

In this example, the controller 110 determines the vibration patterncorresponding to the haptic event using at least one of the inputintensity and duration of the vibration pattern. For example, asdescribed above, the input intensity and duration of the vibrationpattern may be “3” and “0.4 seconds”, respectively. The controller 110determines, as the vibration pattern during a total of 0.4 seconds, ahaptic pattern corresponding to a frequency (f) that has an intensitythat increases from 0 to 03 during a time of t2 and an intensity of 3during a time of t1, to correspond to the collision event between hardand soft objects. Therefore, the vibration pattern of FIG. 15B may bedetermined to correspond to the “collision event between hard and softobjects”.

The vibration pattern is transferred from the haptic engine to a devicedriver in step 1130. The controller 110 transfers the vibration patterndetermined in the haptic engine to the device driver.

The device driver then drives the vibrator based on the vibrationpattern, and embodies a haptic effect in step 1140. The controller 110controls the device driver to drive the vibrator 164 based on thevibration pattern, and embodies a haptic effect. That is, the vibrator164 is driven based on the vibration pattern corresponding to thecollision event between hard and soft objects occurring while the gameapplication is executed, the terminal device 100 is vibrated, and ahaptic effect may be embodied.

Therefore, according to the third embodiment a haptic effect is embodiedby receiving an input of selection with respect to at least one of anintensity and a duration of a vibration pattern, determining a vibrationpattern by applying at least one of the input intensity and duration ofthe vibration pattern to a haptic pattern corresponding to a hapticevent, such as a “collision event between hard and soft objects”, anddriving a vibrator based on the determined vibration pattern.

It will be appreciated that the embodiments of the present invention maybe implemented in a form of hardware, software, or a combination ofhardware and software. Any such software may be stored, for example, ina volatile or non-volatile storage device such as a ROM, a memory suchas a RAM, a memory chip, a memory device, or a memory IC, or arecordable optical or magnetic medium such as a CD, a DVD, a magneticdisk, or a magnetic tape, regardless of its ability to be erased or itsability to be re-recorded. A web widget manufacturing method of thepresent invention can be realized by a computer or a portable terminalincluding a controller and a memory, and it can be seen that the memorycorresponds to an example of the storage medium which is suitable forstoring a program or programs including instructions by which theembodiments of the present invention are realized, and is machinereadable. Accordingly, the present invention includes a program for acode implementing the apparatus and method described in the appendedclaims and a machine (a computer or the like)-readable storage mediumfor storing the program. Moreover, such a program as described above canbe electronically transferred through an arbitrary medium such as acommunication signal transferred through cable or wireless connection,and the present invention properly includes things equivalent to that.

Further, the device can receive the program from a program providingapparatus connected to the device wirelessly or through a wire and storethe received program. The program supply apparatus may include a programthat includes instructions to execute the embodiments of the presentdisclosure, a memory that stores information or the like required forthe embodiments of the present disclosure, a communication unit thatconducts wired or wireless communication with the electronic apparatus,and a control unit that transmits a corresponding program to atransmission/reception apparatus in response.

While the invention has been shown and described with reference tocertain exemplary embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the presentinvention as defined by the appended claims and their equivalents.

What is claimed is:
 1. A method of controlling a terminal device thatprovides a haptic effect, the method comprising: sensing a haptic event;determining a vibration pattern corresponding to the haptic event basedon a combination of at least one of predetermined haptic patternscorresponding to at least one classification; and controlling a vibratorto drive based on the vibration pattern so as to embody the hapticeffect, wherein the at least one classification includes aclassification for determining a type of the haptic event, aclassification for determining a detailed category of the determinedtype of the haptic event, and a classification for determining adetailed feature of the haptic event.
 2. The method of claim 1, whereinthe classification for determining the detailed category of thedetermined type of the haptic event determines a frequency, and theclassification for determining the detailed feature of the haptic eventdetermines an intensity or a duration.
 3. The method of claim 2, whereinthe haptic pattern includes a combination of a plurality ofpredetermined haptic patterns.
 4. The method of claim 1, furthercomprising: receiving an input of selection with respect to at least oneof an intensity and a duration of the vibration pattern.
 5. A devicethat provides a haptic effect, the device comprising: a controllerconfigured to sense a haptic event; determine a vibration patterncorresponding to the haptic event based on a combination of at least oneof predetermined haptic patterns corresponding to at least oneclassification, and control a vibrator to drive based on the vibrationpattern so as to embody a haptic effect; the vibrator that vibrates thedevice; and a storage unit that stores the vibration patterncorresponding to the haptic event, wherein the at least oneclassification includes a classification for determining a type of thehaptic event, a classification for determining a detailed category ofthe determined type of the haptic event, and a classification fordetermining a detailed feature of the haptic event.
 6. The device ofclaim 5, wherein the classification for determining the detailedcategory of the determined type of the haptic event determines afrequency, and the classification for determining the detailed featureof the haptic event determines an intensity or a duration.
 7. The deviceof claim 6, wherein the haptic pattern comprises a combination of aplurality of predetermined haptic patterns.
 8. The terminal device ofclaim 5, wherein the controller receives an input of selection withrespect to at least one of an intensity and a duration of the vibrationpattern.